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LECTURE 28. REPEATED EIGENVALUES AND THE MATRIX EXPONENTIAL 



Repeated eigenvalues. Again, we start with the real n x n system 

(28.1) y' = Ay. 

We say an eigenvalue A=k or A is repeated if it is a multiple root of pa(A). That is, pa(A) has 
(A — A*)^ as a factor. We suppose that A* is a double root of pa(A), so that in principle two linearly 
independent solutions of (28.1) correspond to A*. If v^, is the corresponding eigenvector, then 
y = u*e^** is a solution. The problem is to find the second solution of (28.1), linearly independent 
of . We first discuss an easy case. 



Example 28.1 (The complete case). Still supposing that A=k is a double root of paW, we say A* is a 
complete eigenvalue if there are two linearly independent eigenvectors corresponding to A^,, say vi 
and V2- Using them, we obtain two linearly independent solutions of (28.1), namely 

yi{t) = iTie-^i* and mit) = iTae^^* 

Exercise. Let A be a 2 x 2 matrix. If A is a repeated and complete eigenvalue of A, show that 




The converse holds true. 

In general, if an eigenvalue A* of A is /c-tuply repeated, that is, pa(A) = | A — A/| has the power 
( A — A,, ) as a factor, but no higher, the eigenvalue is called complete if k linearly independent eigen- 
vectors correspond to A* . In this case, these eigenvectors produce k linearly independent solutions 
of (28.1). An important result in linear algebra is that if a real square matrix A is symmetric, that 
is, A = AJ- , then all its eigenvalues are real and complete. 

However, in general, an eigenvalue of multiplicity k (> 1) has less than k eigenvectors, and we 
cannot construct the general solution from the techniques of eigenvalues. 

The matrix exponential. To motivate, the initial value problem 

y = ay, y(0) = 1 

has the solution y{t) = e"* in the form of exponential. We want to define the expression e"^* for a 
general n x n matrix A, n ^ 1, so that Y{t) = e"^* is a solution of 

Y' = AY, y(o) = / 

and moreover e"^* is easy to compute. 
Recall that if a is a real number then 

at . {at? {atT ^{atT 

e"* = 1 + at + ^-^ + • • • + + ... = Y 

2! n\ ^ n\ 

n=0 



1 



where t G R. A natural way to define the matrix exponential e^^, for an n x n matrix A, seems to 
use the series expression 



(28.2) e^* = I + M+ — + ••• + — + •• - = 5^^. 

n=0 

In order to make sense of the above expression, we first introduce the matrix norm. 
Definition 28.2. For an n x n matrix A, define the matrix norm as 

ll^ll = sup -p^j-) 

m \y\ 

where \y\ = |y^y|V2 = (y2 + . . . + ^2)1/2 \Ay\ = \{Ayf {Ay)\^l\ 
Exercise. Show that 

P + ^ IIAII + ll^ll, = pll ||5||, ||U|| = |t| pll 

for any matrices A^ B and for any t G M. 

For a matrix-valued function A{t) = (ajj(i))f ^^j^, then Ait) Ait^) means equivalently: 

(i) aijit) aij{to) ast —>■ to for all 1 ^ i,j ^ n. 

(ii) -^(io)ll ^Oast^to- 
Under the matrix norm, the infinite series (28.2) converges for all A and for all t, and it defines 

the matrix exponential. 

We now compute the derivative of e^^ by differentiating the right side of (28.2) term by term 

=A + tA + --- + — + • • • 

[n — Ij! 

Moreover, since e^'^ = I, by definition, the matrix exponential e"^* is a solution of 

Y' = AY, y(o) = /. 
Theorem 28.3. Let Y{t) be a fundamental matrix of A. Then Y{t) = 1^(0)6"^*. 

For several classes of A, the infinite series in (28.2) can be summed up exactly. 

Exercise. 1. Show that exp(diag (Ai ... A„)) = diag (e^^ . . . e^"). 

A M ^0 t 



2. Show that if A = then e \q q 

Exercise. Prove the exponential law 

(28.3) e(^+^)* = e^*e^* if AB = BA. 

We use (28.3) to compute the matrix exponentials of more matrices. 

Example 28.4. Let A = ( ^ 2 ' ' write A = B + C, where 
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Since BC = CB, by the results from the previous exercise and by (28.3) 



At _ / \ (I t\ _ ot A t 
e2*] lo l]-^ 10 1 



Finding the fundamental matrix. In general, it doesn't seem possible to express e^* in closed 
form. Nevertheless, we can find n independent vectors for which e^* can be computed exactly. 
The idea is to write 



If {A — XI)"^v = for some integer m > 0, then {A — A/)'"+'i; = for all integers / ^ 0. Hence, 

(m-1)!* 



J-TTt—l 

g(A-A/)t^ = t; + t(A - XI)v + ■■■ + -{A - XI)"'-^v 



is a finite sum, and 



t 



m— 1 



e^V =e^Uv + t{A-XI)v + --- + {A - XlY'-^v 

\ [m — Ij! 

can be computed exactly, although e^^ itself cannot be computed. 

Example 28.5. Solve the system Y' = AY, where 

/I 1 0^ 
A = 1 
\0 2^ 

Solution. Its characteristic polynomial is pa(A) = (1 — A)^(2 — A), and it has a double root A = 1 
and a simple root A = 2. 
If A = 1, then 

/O 1 0\ 

{A-XI)v= hT=0 

has a solution vi = . Furthermore, it is the only eigenvector for A = 1 up to a constant 

multiple. (In fact, the well-known result from linear algebra tells us that the solution space of 
the above linear system of equations has dimension 1. ) One solution of the system Y' = AY is 

obtained and yi (t) = e* 

To find the second solution associated to A = 1, we compute 

/O 0\ 
{A-Xlfv= h; = 
Vo 1/ 

^0^ 

has a nontrivial solution V2 = I 1 I / linearly independent to vi. On the other hand, {A — I)v2 / 0. 



Thus, 



.0> 



e^^iJ^ = e\l + t{A-I)v2)=e' | 1 

.0 
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and it gives an additional solution of the system Y' = AY associated to A = 1. 
Finally, if A = 2 then 

{A-1l)v = 




has a solution 7/3 = . Hence, 2/3 (t) = e^* 

vv 

The general solution of the system Y' = AY can be written as 

Y{t) = (Ci + tC2)(^'V\ + C2e^V2 + C3e^*W3. 

It is analogous to that for the scalar differential equations with multiple roots. 

We conclude the lecture by the following important result in linear algebra. 

Theorem 28.6 (Cayley-Hamilton Theorem). Any square matrix A satisfies p{A) = 0, where p is the 
characteristic polynomial of A. 

Proof. Recall the formula 

adj {A - XI) ■ {A - XI) = p{X)I. 

Both sides are polynomial expressions for A G M. We view them as matrix polynomials, that is to 
say, we replace A by a matrix. By setting X = A then proves the assertion. □ 
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